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~ The MAILING DATE of this communication appears on the cover sheet with the correspondence address- 

All claims being allowable, PROSECUTION ON THE MERITS IS (OR REMAINS) CLOSED in this application. If not included 
herewith (or previously mailed), a Notice of Allowance (PTOL-85) or other appropriate communication will be mailed in due course. THIS 
NOTICE OF ALLOWABILITY IS NOT A GRANT OF PATENT RIGHTS. This application is subject to withdrawal from issue at the initiative 
of the Office or upon petition by the applicant. See 37 CFR 1.313 and MPEP 1308. 

1 . This communication is responsive to 4/15/08 . 

2. The allowed claim(s) is/are 1-3,5-17,19-32 and 34-42 . 

3. □ Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 

a) □ All b)DSome* c) □ None of the: 

1. □ Certified copies of the priority documents have been received. 

2. □ Certified copies of the priority documents have been received in Application No. . 

3. □ Copies of the certified copies of the priority documents have been received in this national stage application from the 

International Bureau (PCT Rule 17.2(a)). 
* Certified copies not received: . 

Applicant has THREE MONTHS FROM THE "MAILING DATE" of this communication to file a reply complying with the requirements 
noted below. Failure to timely comply will result in ABANDONMENT of this application. 
THIS THREE-MONTH PERIOD IS NOT EXTENDABLE. 

4. □ A SUBSTITUTE OATH OR DECLARATION must be submitted. Note the attached EXAMINER'S AMENDMENT or NOTICE OF 

INFORMAL PATENT APPLICATION (PTO-152) which gives reason(s) why the oath or declaration is deficient. 

5. □ CORRECTED DRAWINGS ( as "replacement sheets") must be submitted. 

(a) □ including changes required by the Notice of Draftsperson's Patent Drawing Review ( PTO-948) attached 

1 ) □ hereto or 2) □ to Paper No./Mail Date . 

(b) □ including changes required by the attached Examiner's Amendment / Comment or in the Office action of 

Paper No./Mail Date . 

Identifying indicia such as the application number (see 37 CFR 1. 84(c)) should be written on the drawings in the front (not the back) of 
each sheet. Replacement sheet(s) should be labeled as such in the header according to 37 CFR 1.121(d). 

6. □ DEPOSIT OF and/or INFORMATION about the deposit of BIOLOGICAL MATERIAL must be submitted. Note the 

attached Examiner's comment regarding REQUIREMENT FOR THE DEPOSIT OF BIOLOGICAL MATERIAL. 



Attachment(s) 

1 . ^ Notice of References Cited (PTO-892) 

2. □ Notice of Draftperson's Patent Drawing Review (PTO-948) 

3. □ Information Disclosure Statements (PTO/SB/08), 

Paper No./Mail Date 

4. □ Examiner's Comment Regarding Requirement for Deposit 

of Biological Material 



5. □ Notice of Informal Patent Application 

6. □ Interview Summary (PTO-413), 

Paper No./Mail Date . 

7. □ Examiner's Amendment/Comment 

8. ^ Examiner's Statement of Reasons for Allowance 

9. □ Other . 

/Richard Hjerpe/ 
Supervisory Patent Examiner 
Art Unit 2629 
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DETAILED ACTION 
Allowable Subject Matter 

1. Claims 6-11 are allowed. 

The following is an examiner's statement of reasons for allowance: Claims 6-11 are 
allowed since certain key features of the claimed invention are not taught or fairly suggested by 
prior art. As to claim 1, " a controller to determine at least one of positioning and relative 
movement for a graphical-user interface clement displayed on the display, based on the images 
captured by the image-capturing mechanism, by determining: a first location of the at least one 
corner of the display in the first image, a second location of the at least one corner of the display 
in the second image, and an amount and a direction of movement of the at least one corner of the 
display from the first location in the first image to the second location in the second image". 

As to claim 16, "wherein at least one of positioning and relative movement for a graphical-user 
interface element displayed on the display is determined based on the images captured by the 
image-capturing mechanism, by determining: a first location of the at least one corner of the 
display in the first image, a second location of the at least one corner of the display in the second 
image, and an amount and a direction of movement of the at least one corner of the display from 
the first location in the first image to the second location in the second image". As to claims 29, 
"means for determining relative movement for a graphical-user interface element displayed on 
the display based on a change in position of the at least one corner of the display between the 
first image and [[a]] the second image captured by the image-capturing mechanism , by 
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determining: a first location of the at least one corner of the display in the first image, a second 
location of the at least one corner of the display in the second image, and an amount and a 
direction of movement of the at least one corner of the display from the first location in the first 
image to the second location in the second image". As to claim 30, "means for determining 
positioning for a graphical-user interface element displayed on the display based on a position of 
the at least one corner of the display within an image captured by the image-capturing 
mechanism relative to a field of view of the image, by determining: a first location of the at least 
one corner of the display in the first image, a second location of the at least one corner of the 
display in the second image, and an amount and a direction of movement of the at least one 
corner of the display from the first location in the first image to the second location in the second 
image". As to claim 31, "determining an amount and a direction of movement of the at least one 
corner of the display between the first image and the second image; and, causing a graphical-user 
interface element displayed on the display by the computing device to move based on the amount 
and the direction of the movement of the at least one corner of the display- wherein determining 
the amount and the direction of movement of the at least one corner of the display between the 
first image and the second image comprises: determining a first location of the at least one corner 
of the display in the first image; determining a second location of the at least one corner of the 
display in the second image; and, determining the amount and the direction of movement of the 
at least one corner of the display from the first location in the first image to the second location 
in the second image". As to claim 35, "determining a location of at least the center of the display 
within the image; determining an offset amount and an offset direction between the location of at 
least the center of the display within the image and a center of the image; and, causing a 
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graphical-user interface element to be displayed on the display by the computing device at a 
position based on the offset amount and the offset direction between the location of at least the 
center of the display within the image and the center of the image". As to claim 38, " providing 
a controller of the pointing device capable of determining at least one of positioning and relative 
movement for a graphical-user interface element displayed on the display, based on the images 
captured by the image-capturing mechanism, by determining: a first location of the at least one 
corner of the display in the first image, a second location of the at least one corner of the display 
in the second image, and an amount and a direction of movement of the at least one corner of the 
display from the first location in the first image to the second location in the second image". 

The closest prior Sukthankar et al. (6,618,076) teach automatically calibrate a projector camera 
system to recover the mapping from a given point in the source image and its corresponding 
point in the camera image, Hansen (6,275,214 Bl) teaches a remotely controlling a computer 
having a screen for displaying output from the computer and having an internal cursor generated 
by the computer, however, singularly or in combination with other prior art, fail to anticipate or 
render the claimed limitations, at least "" a controller to determine at least one of positioning 
and relative movement for a graphical-user interface element displayed on the display, based on 
the images captured by the image-capturing mechanism, by determining: a first location of the at 
least one corner of the display in the first image, a second location of the at least one corner of 
the display in the second image, and an amount and a direction of movement of the at least one 
corner of the display from the first location in the first image to the second location in the second 
image". 
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2. Any comments considered necessary by applicant must be submitted no later than the 
payment of the issue fee and, to avoid processing delays, should preferably accompany the issue 
fee. Such submissions should be clearly labeled "Comments on Statement of Reasons for 
Allowance." 



Conclusion 

3. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Mansour M. Said whose telephone number is 571-272-7679. The 
examiner can normally be reached on Monday through Thursday from 8:30-6:00 P.M. The 
examiner can also be reached on alternate Friday from 8:30 a.m. to 5:00 p.m. EST. If attempts to 
reach the examiner by telephone are unsuccessful, the examiner's supervisor, Richard A. Hjerpe 
whose telephone number is 571-272-7681. 

Any response to this action should be mailed to: 

Commissioner of Patents and Trademarks 
Washington, D.C. 20231 
or faxed to: 571-273-8300 (for Technology Center 2600 only) 
Hand-delivered responses should be brought to the Customer Service Window at the 
Randolph Building, 401, Dulany Street, Alexandria, VA 22314. 

Information regarding the status of an application may be obtained from the Patent Application 
Information Retrieval (PAIR) system. Status information for published applications may be 
obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
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system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 



/MANSOUR M SAID/ 
Examiner, Art Unit 2629 

/Richard Hjerpe/ 

Supervisory Patent Examiner, Art Unit 2629 



